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INTERCONNECTION OF AUDIOA/IDEO DEVICES 

5 The present invention relates to systems connposed of a plurality of 

devices clustered for the exchange of data, preferably audio and/or video data 
and control messages, via wired or wireless link and, in particular although not 
essentially, to such systems where different data components from a source 
device are to be routed to respective and separate other devices of the 
10 system. The invention further relates to source devices for use in such 
systems. 

Networking or interconnection of devices has long been known and 
used, starting from basic systems where different system functions have been 

15 provided by separate units, for example hi-fi or so-called home cinema 
systems. A development has been the so-called home bus systems where a 
greater variety of products have been linked with a view to providing enhanced 
overall functionality in for example domestic audio/video apparatus coupled 
with a home security system and the use of telephone. An example of such a 

20 home bus system is the domestic digital bus (D2B), the communications 
protocols for which have been issued as standard I EC 1030 by the 
International Electrotechnical Commission in Geneva, Switzerland. The D2B 
system provides a single wire control bus to which all devices are interfaced 
with messages carried between the various devices of the system in a 

25 standardised form of data packet. 

A particular problem that can occur with distributed systems such as hi- 
fi and home cinema is loss of synchronisation between different components 
required to be presented to a user simultaneously. This is particularly 
noticeable where the loss of synchronisation is between sequences of video 

30 images and an accompanying soundtrack, or between different audio 
components intended to be presented by different devices, particularly in a 
surround-sound or home-cinema installation. This loss of synchronisation may 
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occur due differences in the effective lengths of the transmission paths for the 
differing components, or it may be due to different latencies in decoders for 
the different components. 

One way to approach the synchronisation problem, where all the 

5 components are decoded within a single device, is described in US 5,430,485 
(Lankford et a!) which describes a receiver for decoding associated 
compressed video and audio information components transmitted in mutually 
exclusive frames of data, each with a respective presentation time stamp. A 
coarse synchronisation is applied by selectively dropping frames of one or 
10 other of the components and then fine tuning by adjusting the audio stream 
clock frequency. 

Another approach, this time closer to the source for different 
components being sent out, is described in US 5,594,660 (Sung et al) which 
provides an audio/video decoder/decompressor- for receiving and separating 

15 the components of an encoded and compressed data stream. Within the 
decoder/decompressor, Sung has means for breaking up a compound AV 
stream and then applying an appropriate temporal offset to each stream to 
achieve synchronisation of the outputs during playback. The differential 
buffering by FIFO units follows the system decoder but precedes the decoding 

20 of the audio or of the video. 

Although handling the component delays with the components still 
encoded generally involves less processing, handling of synchronisation at 
source can create its own problems when it comes to avoiding conflict for 
transport resources to get the offset streams to their destination without 

25 introducing further delays (and hence un-synchronising the streams) and/or 
requiring separate and parallel signal paths for the separated components. 

It is accordingly an object of the present invention to provide a 
networked system of devices including means for synchronising components 
30 from source whilst avoiding the creating of delays through competition 
between source and destination. 

In accordance with the present invention there is provided a data 
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processing system comprising a cluster of devices interconnected . for the 
communication of data in streams, wherein one of said devices is a source 
device for at least two data streams to be sent to one or more other devices as 
destination devices of said cluster, said source device including: buffering 
5 means arranged to apply a respective delay to at least one of said at least two 
data streams; and multiplexing means coupled with said buffering means and 
arranged to combine said at least two streams into a single data stream for 
transmission; the system further comprising a first data channel linking said 
source and destination devices and carrying said data stream for transmission 

10 from the source device to the or each destination device. By applying the 
respective delays at source, the amount of signal buffering received by the 
destination devices is kept to a lower level, whilst the multiplexing of the signal 
streams with latency offsets applied reduces congestion problems arising from 
separate streams competing for transmission pathways. 

1 5 The source device may further comprise an input to receive the said at 

least two data streams from a remote source (such as a further connected 
device or perhaps an internal utility such as an optical disc reader). With such 
an arrangement, where the at least two data streams are multiplexed together 
when received by said source device, the source device suitably further 

20 comprises demultiplexing means coupling the input and the buffering means 
and arranged to separate said streams prior to buffering. 

In a preferred embodiment, the aforementioned at least two data streams 
comprise digital video data and audio data (which may be digital audio data) 
respectively, wherein the digital video data may have a different destination 

25 device to the audio data. 

To allow further treatments to the signals to be sent out, the source 
device may further comprise data processing means interposed in the signal 
path between the buffering and multiplexing means. 

The present invention also provides a data processing apparatus 

30 comprising the technical features of a source device in a system as recited 
hereinabove and as claimed in the claims attached hereto, to which the readers 
attention is now directed. 
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Further features and advantages of the present invention will become 
apparent from reading of the description of preferred embodiments of the 
invention, given by way of example only and with reference to the 
5 accompanying drawings, in which: 

Figure 1 represents an arrangement of three interconnected devices 
forming an audio/video cluster; 

Figure 2 represents a first application of differential delays applied to 
separate components from a first source; 
1 0 Figure 3 represents an alternative application of delays to that of Figure 

2; and 

Figure 4 represents an alternative (wireless) interconnect mechanism 
suitable to embody the present invention. 

1 5 A first arrangement of interconnected devices is shown in Figure 1 , with 

three devices 10, 12, 14 forming a cluster 16 based around a respective bus 
18 supporting communication in accordance with IEEE Standard 1394 
connect and communications protocols. In the following example, reference is 
made to IEEE 1394, and the disclosure of the specification of this protocol is 

20 incorporated herein by reference. As will be recognised by the skilled reader, 
however, conformance with such protocol is not essential to the operation of 
the present invention. . . 

The devices in the cluster 16 comprise a source device 10 coupled via 
bus 18 to a television 12 for showing the image component of a combined AV 

25 stream from the source, and an audio processor and playback system 14 for 
reproducing the audio component of the-AV stream. The source device 10 
comprises an audio stream buffer 20 and a video stream buffer 22 for receiving 
separate input components from a remote signal source 24. As shown, the 
separate source components A and B are combined in a multiplexer. 26 with the 

30 source device 10 having a corresponding demultiplexer 28 to separate the 
components prior to loading them into the respective buffers 20, 22. 

Under the direction of a controlling processor 30, the buffers are used to 
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apply a respective delay to at least one of the two data streams to combat the 
differing processing latencies in the video 12 and audio 14 destination devices, 
as will be described in further detail hereinafter with respect to Figures 2 and 3, 
Also under the direction of the processor 30, a multiplexer stage 32 
5 remultiplexes the temporally offset audio and video from the respective buffers 
to combine the two streams into a single data stream for transmission via the 
1394 bus 18. 

Whilst the signals in the respective buffers 20, 22 may simply be read out 
and recombined, the source device optionally further comphses data processing 

10 means interposed in the signal path between the buffers 20, 22 and the 
multiplexer 32. As shown, this further data processing means may take the 
form of an audio signal processor ASP 34 on the output to the audio signal 
buffer and a video signal processor VSR 36 on the output to the video signal 
buffer. The ASP 34 may be used for tasks such as conversion from AC3 or 

15 MPEG Audio to LPCM, such that only the source device would then require a 
decoder for these formats. The video processing by VSP 36 could include 
overlaying graphics and/or various forms of re-encoding, for example to identify 
MPEG l-fields. Whilst the output from the audio buffer 20 is typically passed to 
the multiplexer 32 in digitised form, an analogue audio signal may be required 

20 for communication with other (non 1394-compliant) devices and, to this end the 
ASP 34 may include a D/A converter (not shown) such as to provide an 
analogue audio output 38. Alternately, the ASP 34 might act as a gateway to a 
second cluster 37 by providing a link 39 supporting conversion to (and optionally 
from) a different interconnect protocol such as IEC958: this arrangement has 

25 particular value when, for example, it is desired to watch a digital video on 
television 12 conforming to IEEE1394 whilst listening to the audio on a slightly 
older system conforming to IEC958. 

The first and second data streams (audio and video) may be encoded 
according to a first communications protocol such as MPEG1 or 2, and the 

30 destination devices 12, 14 are each provided with a respective decoder 40, 42 
operating according to the said protocol. 

Turning now to Figure 2, the differential delays applied are illustrated with 
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a data source DS 24 outputting digital video DV and digital audio DA to 
respectively a digital television 44 and a digital amplifier 46 via respective 
buffers 48, 50. The digital source 24 may comprise, for example, a DVD player 
and the digital TV 44 may be provided with an MPEG2 decoder to handle the 
5 coded video from the source, and the digital amplifier may be provided with an 
ACS decoder for the coded audio. Typically, the latency of the ACS decoder will 
be of the order- of 10ms as . against 500ms for the MPEG2 decoder. 
Consequently, to maintain synchronism between the audio and video playback, 
the audio signal is delayed in the buffer 50 by (500 -10) = 490ms, with the digital 

1 0 video being pipelined directly through the video buffer 48 with no delay. 

Figure 3 shows an alternative scenario to that of Figure 2: in this case, 
the source 24.A outputs an analogue audio signal AA via analogue delay line 54 
to analogue amplifier 52. In the absence of any specific coding, the latency of 
the analogue amplifier is assumed negligible and consequently the delay 

15 introduced by buffering (in delay line 54) must be (500 - 0) = 500ms. Other 
variations are, of course, possible with the output from source 24.A instead 
comprising a digital audio stream but, unlike the Figure 2 embodiment, the video 
and audio streams conform to separate protocols (such as IEEE 1394 for the 
video and IEC958 for the audio) with respective delay settings being as for the 

20 digital plus analogue case of Figure 3, or varied in dependence on the actual 
settings, as will be recognised by the skilled reader. 

From reading the present disclosure, other modifications and variations 
will be apparent to persons skilled in the art, including equivalents and features 
which are already known in the field of bus-connected and cordless 

25 communication systems and components and which may be used instead of or 
in addition to features already disclosed herein. For example, as shown by 
Figure 4, the source 58 may comprise an optical or magnetic disk reader and, 
instead of a digital data bus, the data channel from source 60 to destination 
devices 62, 64, 66 may be a wireless communications link 68 for which each of 

30 the destination devices is provided with at least a receiver and the source device 
is provided with at least a transmitter. The system may comprise many more 
devices than illustrated herein including, for example, two or more source 
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devices, and some devices of the system may have the technical features of 
. both source and destination (for example a video cassette record and playback 
deck) with the appropriate source/destination behaviour being selected in 
dependence on the context. 
5 In the foregoing we have described a data processing system comprising 

a cluster of devices interconnected for the communication of data in streams, 
particularly digital audio and/or video data. One of the devices is a source 
device for at least two data streams to be sent to one or more other devices as 
destination devices of the cluster. To enable synchronisation of the stream 
10 presentations by the destination devices, the source device includes buffers to 
apply a respective delay to at least one of the data streams, followed by a 
multiplexer arranged to combine the streams into a single data stream for 
transmission via a data channel linking the source and destination devices. 
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CLAIMS 

1; A data processing system comprising a cluster of devices 
5 interconnected for the communication of data in streams, wherein one of said 
devices is a source device for at least two data streams to be sent to one or 
more other devices as destination devices of said cluster, said source device 
including: 

buffering means arranged to apply a respective delay to at least one of 
1 0 said at least two data streams; and 

multiplexing means coupled with said buffering means and arranged to 
combine said at least two streams into a single data stream for transmission; 

the system further comprising a first data channel linking said source and 
destination devices and carrying said data stream for transmission from the 
1 5 source device to the or each destination device. 

2. A system as claimed in Claim 1, wherein said source device 
further comprises an input to receive said at least two data streams from a 
remote source. 

20 

3. A system as claimed in Claim 2, wherein said at least two data 
streams are multiplexed together when received by said source device, said 
source device further comprising demultiplexing means coupling said input and 
said buffering means and arranged to separate said streams prior to buffering. 

25 

4. A system as claimed in Claim 1, wherein said at least two data 
streams comprise digital video data and audio data respectively, wherein the 
digital video data has a different destination device to the audio data. 

30 5. A system as claimed in Claim 4, wherein said audio data is digital 

audio data. 
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6- A system as claimed in any of Claims 1 to 5, wherein said source 
device further comprises data processing means interposed in the signal path 
between said buffering means and said multiplexing means. 

5 7. A system as claimed in any preceding Claim, wherein the first and 

second data streams are encoded according to a first communications protocol, 
and the or each destination device comprises a respective decoder operating 
according to said protocol. 

10 8. A system as claimed in Claim 1, wherein said first data channel is 

a digital data communication bus to which the devices are respectively 
interfaced, with said multiplexed data streams being carried thereupon as 
discrete data packets. 

15 9. A system as claimed in Claim 1, wherein said first data channel is 

a wireless communications link for which each of the destination devices is 
provided with at least a receiver and said source device is provided with at least 
a transmitter. 

20 10. A system as claimed in any preceding Claim, comprising two or 

more source devices. 

11. A system as claimed in Claim 1 0, wherein at least one of said two 
or more source devices further comprises the technical features of a destination 

25 device of the system. 

12. Data processing apparatus comprising the technical features of a 
source device in a system as claimed in any of Claims 1 to 9. 

30 13. Data processing apparatus as claimed in Claim 12, further 

comprising the technical features of a destination device in a system as claimed 
in any of Claims 1 to 9. 
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14. A data processing system comprising a cluster of devices 
interconnected for the communication of data in streams substantially as 
hereinbefore described with reference to the accompanying drawings. 

15. A data processing apparatus for use as a source device in a 
system comprising a cluster of devices interconnected for the communication of 
data in streams substantially as hereinbefore described with reference to the 
accompanying drawings. 
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ABSTRACT 

INTERCONNECTION OF AUDIOA/IDEO DEVICES 

5 

A data processing system comprises a cluster of devices (16) 
interconnected for the communication of data in streams, particularly digital 
audio and/or video data. One of the devices (10) is a source device for at least 
two data streams to be sent to one or more other devices (12, 14) as destination 

10 devices of the cluster. To enable synchronisation of the stream presentations by 
the destination devices, the source device (10) includes buffers (20, 22) 
arranged to apply a respective delay to at least one of the data streams, 
followed by a multiplexer (32) arranged to combine the streams into a single 
data stream for transmission via a first data channel (18) linking said source (10) 

15 and destination (12. 14) devices. The source device may include data 
processing means (34, 36) interposed in the signal path between the buffers 
and multiplexer. 

(Figure 1) 
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